RCOH -1066 / AP 03-372 PATENT 



A pparatus, Method, Software and Medium Storage for Performing The Tasks of 

Detecting Specified Marks 



Field of the Invention 

The current invention is generally related to a device, a software program and a 
storage medium of the software program for recognizing a predetermined mark, and more 
10 particularly related to generating a dictionary for the mark recognition and recognizing the 
predetermined mark that has been rotated by an unknown amount. 

BACKGROUND OF THE INVENTION 

15 It has been known that the simplest method of detecting an image portion that has 

been rotated by an unknown amount of degrees (a rotated image) is based upon matching 
the rotated input image and a plurality of predetermined rotated templates. However, the 
above described method requires that rotated images degrees are prepared over 360 in the 
dictionary and the memory storage space is substantial for the dictionary. To reduce the 

2 0 memory storage requirement, the templates are prepared for a total of 90 degrees in stead 
of 360 degrees, but the detection is performed over the 360-degree areas. 

A first prior art reference, Japanese Patent Publication Hei 1 1-259657 is entitled 
as "Image Detection Device, Method and Storage Medium." The publication proposes a 
2 5 matching method of input image data converted in angular coordinates and the stored 

image data. A specified image has a constant angle after the image is converted into the 
angular coordinates. The above is true even if the image initially has an unknown angle. 
Based upon the above characteristics, a single set of image data is stored with respect to a 
standard object in stead of 360 degrees of the rotated image data. 
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A second prior art reference, Japanese Patent Publication Hei 2000-163586 is 
entitled as "Mark Recognition Device." The publication discloses that a circular object 
including the chiseled seal mark is scanned, and the center of the circular object is 
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determined in the image data. The digital image is generated by emphasizing the edge 
portions of the seal mark. Subsequently, the seal mark image is generated by converting 
the above generated edge digital image into polar coordinates with respect to the detected 
center. For each direction of the edge lines, the frequency distribution is extracted as a 
power spectrum or a characteristic value. The extracted characteristic value is compared 
to the already stored seal mark characteristic values or templates, and the seal marks that 
have been chiseled on the engine valve or on a circular metallic surface such as a coin are 
thus recognized. 

As described above, the recognition process is performed corresponding to an 
arbitrarily rotated angle along the circumference. Even if there are various noises, the 
recognition process is performed at a high precision level without being influenced by the 
noises. Furthermore, since the recognition process does not include the calculation 
intensive process, the recognition process is performed at a sufficiently high speed. 

A third prior art reference, Japanese Patent Publication Hei 6-274736 is entitled 
as "Currency Recognition Device." The surface pattern is scanned from the currency, and 
the center of the currency portion is detected from the two-dimensional image data. About 
the currency center, the two-dimensional image is converted into polar coordinates. 
Furthermore, the frequency distribution of the image data along the circumferential 
directions is orthogonally converted to obtain a characteristic value or a power spectrum. 
For example to determine a currency type, the obtained characteristic value is compared to 
the already stored templates of characteristic values indicative of the front and back 
surfaces of the various currencies. In the above described method, it is necessary to 
prepare only the templates of the characteristic values indicative of the front and back 
surfaces of the various currencies. Even if the size and the material are substantially 
identical, the currency type is recognized with certainty without correcting the rotational 
angle. 

A fourth prior art reference, Japanese Patent Publication 2001-43365 is entitled as 
"Still Image Characteristic Extraction Method." The orthogonal coordinate data of the 
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digital information and the texture information are extracted from a given object in the still 
image. Assuming a circle circumscribing the object, in the coordinate whose origin is the 
center of the circle, a predetermined number is re-sampled from 0 to 2n in the radial 
direction of the circle from the origin so as to convert the orthogonal coordinate data into 
5 the polar coordinate data. From the polar coordinate data, the characteristic value is 

determined for the object. The characteristic value is independent of the object size or the 
object rotation. In other words, the characteristic value facilitates the matching process 
without performing the calculation related to rotation. 

10 A fifth prior art reference, Japanese Patent Publication Hei 9-147109 is entitled as 

"Method and Device for Detecting Predetermined Mark." To detect a specified mark in an 
image, a radial polynomial table is prepared in advance based upon the size of the specified 
mark. In the process of detecting the specified mark, the radial polynomial table is 
modified based upon the reduction/expansion ratio of the image. The Zennike Moment is 

1 5 determined by the sum of products between the image and the modified radial polynomial 
table. The above described method allows the fast and precise detection of a specified 
mark at an arbitrary position, an arbitrary angle and an arbitrary scale. 

A sixth prior art reference, Japanese Patent Publication Hei 9-179982 is entitled 
20 as "Predetermined Mark Detection Method." In detecting a specified pattern using the 
rotationally independent multidimensional characteristic value, the characteristic value at 
each dimension must be rotationally independent, and the characteristic value must be 
determined based upon the central angle. By changing a standard for the central angle 
determination for each dimension, the image information is minimally lost, and the image 
25 is detected or recognized at a high precision level. 

On the other hand, the following method is known to detect a circular specified 
image in an input image. A seventh prior art reference, Japanese Patent Publication Hei 
1 1-1 10562 is entitled as "Pattern Recognition Method, Device and Recording Medium." 
3 0 The presence of edges is determined from multiple positions towards the center of the 
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input image. When the edge has been detected from multiple positions, it is determined 
that an image having an outer circular shape is detected in the input image. 

Furthermore, a eighth prior art reference, Japanese Patent Publication 2001- 
5 33 1805 is entitled as "Upper Semi Circular Image Detection Method." In the input image, 
a pattern is searched to match initial search conditions. It is determined based upon the 
dictionary whether or not the distance between the middle point to either a right or left 
edge is within the prescribed distance from an upper edge in a sub-scanning direction in the 
searched pattern. If the number of lines beyond the prescribed distance is below a 
10 predetermined threshold value and the search reaches a predetermined radius value, proper 
detection is accomplished despite an improper position due to an edge loss or noise by 
assuming that a semicircle is detected. 

Another image pattern matching method includes the following ninth prior art, 
1 5 Japanese Patent Publication Hei 5-250475, entitled as "Pattern Matching Method." After 
the position of the standard digital image pattern is corrected to coincide at a target pattern, 
unmatched pixels between the standard and target patterns are extracted. The sum of the 
products is determined by multiplying the extracted pixels by coefficients proportionally 
indicative of the characteristics of the standard pattern. The above obtained sum is used to 
2 0 determine the amount of match. The above described method provides an accurate 
evaluation on the match level between the target and standard patterns. 

Despite the above described prior art techniques, there remain undesirable 
features. For example, the first prior art technique requires that as it gets closer to the 

2 5 central portion in an original image, the polar coordinate converted image is more 

stretched. The amount of information for a unit area is less as it gets closer to the center 
coordinates. For example, four pixels around the central coordinate in the perpendicular 
coordinate system are interpolated and stretched over 360 degrees in the polar coordinate 
system. However, as you get farther away from the central coordinate, since the number of 

3 0 pixels increases at the equidistance from the central coordinate, the amount of information 

differs between the near-circumferential area and the near-central area. For this reason, 
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when a simple comparison is made among polar coordinate images, a false determination 
is likely to occur within small radial regions due to errors. To reduce the false 
determination, at least a normalization process is necessary. 

5 In the second, third and four prior art references, since the polar coordinate image 

is further compressed into a characteristic value, the precision is lower than the straight 
comparison of the images. From the point of preventing a false detection, the comparison 
of the characteristic value is not desirable. 

i 

10 In the fifth and sixth prior art references, if the information such as a number of 

dimensions is increased to obtain the same level of functionality as the matching of the 
unprocessed images, it is not common that the dictionary needs to hold more information 
than the templates over 360 degrees. 

1 5 The seventh and eighth prior art references illustrate exemplary techniques of 

determining a matching position for extracting an image. Although the ninth and tenth 
prior art references is related to a technique of extracting a predetermined pattern, neither 
of the prior art references is related to a technique of handing a rotated image. 

2 0 In view of the above issues, there remains some improvement in detecting a 

predetermined mark with an unknown amount of rotation in an input image. The 
improvement lies in a limited size of the template or dictionary and a limited number of 
false detections. The improvements are implemented in a mark detection dictionary 
generation device, a mark detection device, a mark recognition device, a software program 

25 to perform the functions of the above devices or a computer-readable storage medium for 
storing the software program instructions. 

SUMMARY OF THE INVENTION 

30 In order to solve the above and other problems, according to a first aspect of the 

current invention, a method of generating a dictionary for detecting a specified mark, 
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including the steps of: inputting a dictionary image; generating a coordinate conversion 
table containing a list of corresponding coordinates between a predetermined XY 
coordinate and a predetermined polar coordinate for converting the inputted dictionary 
image into polar coordinates, the polar coordinates being expressed by a central distance to 
5 a predetermined center and a central angle; and generating a polar coordinate image for the 
dictionary from the dictionary image based upon the coordinate conversion table. 

According to a second aspect of the current invention, a method of generating a 
dictionary for detecting a specified mark, including the steps of: inputting a specified mark 
1 0 image; converting the specified mark in a polar coordinate image expressed by a central 
distance to a predetermined center and a central angle; storing the polar coordinate image 
in a dictionary; rotating the polar coordinate image; and comparing the rotated polar 
coordinate image and specified mark candidates to determine the specified mark. 

1 5 According to a third aspect of the current invention, a method of generating a 

dictionary for detecting a specified mark, including the steps of: inputting a specified mark 
image; converting the specified mark in a polar coordinate image expressed by a central 
distance to a predetermined center and a central angle; storing the polar coordinate image 
in a dictionary; rotating the polar coordinate image; and comparing pixels in the rotated 

2 0 polar coordinate image and corresponding pixels in specified mark candidates to determine 
the specified mark. 

According to a fourth aspect of the current invention, a computer program 
containing instructions for generating a dictionary and for detecting a specified mark, the 

2 5 instructions including the tasks of: inputting a dictionary image; generating a coordinate 

conversion table containing a list of corresponding coordinates between a predetermined 
XY coordinate and a predetermined polar coordinate for converting the inputted dictionary 
image into polar coordinates, the polar coordinates being expressed by a central distance to 
a predetermined center and a central angle; and generating a polar coordinate image for the 

3 0 dictionary from the dictionary image based upon the coordinate conversion table. 
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According to a fifth aspect of the current invention, a computer program containing 
instructions for generating a dictionary and for detecting a specified mark, the instructions 
including the tasks of: inputting a specified mark image; converting the specified mark in a 
polar coordinate image expressed by a central distance to a predetermined center and a 
5 central angle; storing the polar coordinate image in a dictionary; rotating the polar 

coordinate image; and comparing the rotated polar coordinate image and specified mark 
candidates to determine the specified mark. 

According to a sixth aspect of the current invention, a computer program containing 
10 instructions for generating a dictionary and for detecting a specified mark, the instructions 
including the tasks of: inputting a specified mark image; converting the specified mark in a 
polar coordinate image expressed by a central distance to a predetermined center and a 
central angle; storing the polar coordinate image in a dictionary; rotating the polar 
coordinate image; and comparing pixels in the rotated polar coordinate image and 
15 corresponding pixels in specified mark candidates to determine the specified mark. 

According to a seventh aspect of the current invention, a storage medium for 
storing a computer program containing instructions for generating a dictionary and for 
detecting a specified mark, the instructions including the tasks of: inputting a dictionary 
2 0 image; generating a coordinate conversion table containing a list of corresponding 

coordinates between a predetermined XY coordinate and a predetermined polar coordinate 
for converting the inputted dictionary image into polar coordinates, the polar coordinates 
being expressed by a central distance to a predetermined center and a central angle; and 
generating a polar coordinate image for the dictionary from the dictionary image based 

2 5 upon the coordinate conversion table. 

According to an eighth aspect of the current invention, a storage medium for 
storing a computer program containing instructions for generating a dictionary and for 
detecting a specified mark, the instructions including the tasks of: inputting a specified 

3 0 mark image; converting the specified mark in a polar coordinate image expressed by a 

central distance to a predetermined center and a central angle; storing the polar coordinate 
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image in a dictionary; rotating the polar coordinate image; and comparing the rotated polar 
coordinate image and specified mark candidates to determine the specified mark. 

According to a ninth aspect of the current invention, a storage medium for storing 
5 a computer program containing instructions for generating a dictionary and for detecting a 
specified mark, the instructions including the tasks of: inputting a specified mark image; 
converting the specified mark in a polar coordinate image expressed by a central distance 
to a predetermined center and a central angle; storing the polar coordinate image in a 
dictionary; rotating the polar coordinate image; and comparing pixels in the rotated polar 
1 0 coordinate image and corresponding pixels in specified mark candidates to determine the 
specified mark. 

According to a tenth aspect of the current invention, an apparatus for generating a 
dictionary for detecting a specified mark, including: a dictionary generation image input 

15 unit for inputting a dictionary image; a coordinate conversion table generation unit for 
generating a coordinate conversion table containing a list of corresponding coordinates 
between a predetermined XY coordinate and a predetermined polar coordinate for 
converting the inputted dictionary image into polar coordinates, the polar coordinates being 
expressed by a central distance to a predetermined center and a central angle; and a polar 

2 0 coordinate generation unit connected to the dictionary generation image input unit and the 
coordinate conversion table generation unit for generating a polar coordinate image for the 
dictionary from the dictionary image based upon the coordinate conversion table. 

According to an eleventh aspect of the current invention, an apparatus for 

2 5 generating a dictionary for detecting a specified mark, including: a dictionary generation 

image input unit for inputting a specified mark image; a polar coordinate generation unit 
connected to the dictionary generation image input unit for generating a polar coordinate 
image from the specified mark image based upon a predetermined coordinate conversion 
table, the specified mark in a polar coordinate image being expressed by a central distance 

3 0 to a predetermined center and a central angle; a dictionary unit connected to the polar 

coordinate generation unit for storing the polar coordinate image; and a matching unit 
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connected to the dictionary unit for rotating the polar coordinate image based upon the 
coordinate conversion table, the matching unit comparing the rotated polar coordinate 
image and specified mark candidates to determine the specified mark. 

5 According to a twelfth aspect of the current invention, an apparatus for generating a 

dictionary for detecting a specified mark, including: a dictionary generation image input 
unit for inputting a specified mark image; a polar coordinate generation unit connected to 
the dictionary generation image input unit for generating a polar coordinate image from the 
specified mark image based upon a predetermined coordinate conversion table, the 

1 0 specified mark in a polar coordinate image being expressed by a central distance to a 
predetermined center and a central angle; a dictionary unit connected to the polar 
coordinate generation unit for storing the polar coordinate image; and a matching unit 
connected to the dictionary unit for rotating the polar coordinate image based upon the 
coordinate conversion table, the matching unit comparing pixels in the rotated polar 

1 5 coordinate image and corresponding pixels in specified mark candidates to determine the 
specified mark. 

These and various other advantages and features of novelty which characterize the 
invention are pointed out with particularity in the claims annexed hereto and forming a part 

2 0 hereof. However, for a better understanding of the invention, its advantages, and the 

objects obtained by its use, reference should be made to the drawings which form a further 
part hereof, and to the accompanying descriptive matter, in which there is illustrated and 
described a preferred embodiment of the invention. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a block diagram illustrating one preferred embodiment of the mark 
recognition device according to the current invention. 

3 0 FIGURES 2A and 2B are graphs showing a positional relation between a point on 

the XY perpendicular coordinate system and a point on the r 9 polar coordinate system. 
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FIGURE 3 is a flow chart illustrating steps involved in a preferred process that is 
performed by the coordinate conversion table generation unit 1 1 according to the current 
invention. 

5 FIGURE 4 is an exemplary determination of the angular coordinates in the 

distance r and the angle 0 for the pixel (x 5 y) in the XY coordinate system. 

FIGURE 5 is a table illustrating an exemplary coordinate conversion table for 
converting between the XY coordinate (x, y) and the polar coordinate (r, 9). 

10 

FIGURE 6 is a table illustrating the assignment of a common D scale value for 
the same distance r in the above exemplary coordinate conversion table. 

FIGURE 7 is table illustrating the assignment of a common F scale value in the 
1 5 above exemplary coordinate conversion table. 

FIGURE 8A is a graph illustrating an exemplary coordinate based upon the F and 
D scale values. 

2 0 FIGURE 8B is a graph illustrating an exemplary coordinate based upon the XY 

values. 

FIGURE 9 is a flow chart illustrating steps involved in a preferred process that is 
performed by the polar coordinate image generation unit 13 according to the current 

2 5 invention. 

FIGURE 10 is illustrated a specified mark image using Kanji characters in the 
Japanese language. 

3 0 FIGURE 1 1 is an exemplary polar image from the above example as shown in 

FIGURE 10. 

10 
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FIGURE 12 is a flow chart illustrating steps involved in a preferred process of 
generating an image per rotational angle from the polar coordinate image by the matching 
unit 33 according to the current invention. 

5 

FIGURE 13 is a flow chart illustrating steps involved in a second preferred 
process of generating the polar coordinate conversion table by the coordinate conversion 
table generation unit according to the current invention. 

10 FIGURE 14 is a table illustrating an exemplary coordinate conversion table 

values with the D and F scale values whose D values have been clustered in the coordinate 
conversion table of FIGURE 7. 



FIGURE 15 is an exemplary polar coordinate image as generated from the 
15 exemplary specified mark of FIGURE 10 based upon the conversion table of FIGURE 10 
that contains the clustered D scale values. 



FIGURE 16 is a flow chart illustrating steps involved in the process that are 
performed by the polar coordinate image generating unit 13 in the third preferred 
2 0 embodiment according to the current invention. 

FIGURE 17 is diagram illustrating a first set of exemplary rotated dictionary 
images for determining a pixel value in one polar coordinate image based upon the 
coordinate conversion table. 

25 

FIGURE 18 is a diagram illustrating a second set of exemplary rotated dictionary 
images that has been rotated by 360/ 0 from those of FIGURE 17 for determining a pixel 
value in one polar coordinate image. 



3 0 FIGURE 19 is a flow chart illustrates steps involved in a preferred process of 

generating the coordinate conversion table by the coordinate conversion table generation 
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unit based upon a standard central angle of the selected pixel having the same D scale 
value according to the current invention. 

FIGURE 20 is a table illustrating exemplary coordinate conversion table values 
5 that have been generated by the above preferred process as described with respect to 
FIGURE 19. 

FIGURE 2 1 is a flow chart illustrating the steps involved in changing the 
standard for the central angle determination by changing the steps of the polar coordinate 
10 image generating unit 13 in generating the polar coordinate image. 

FIGURE 22 is diagram illustrating a third set of exemplary rotated dictionary 
images for determining a pixel value in one polar coordinate image. 

15 FIGURE 23 is diagram illustrating a fourth set of exemplary rotated dictionary 

images that has been rotated by 360/ 0 from those of FIGURE 22 for determining a pixel 
value in one polar coordinate image. 

FIGURE 24 is an exemplary polar coordinate image generated from the specified 
2 0 mark image of FIGURE 10 based upon the coordinate conversion table for which the 
standard has been changed. 

FIGURE 25 is an exemplary polar coordinate image generated from the specified 
mark image of FIGURE 10 based upon the coordinate conversion table for which the 
2 5 standard has been changed and whose scale values have been clustered. 

FIGURE 26 is a flow chart illustrating steps involved in a preferred process of 
matching by the matching unit 33 without reconstructing the entire XY coordinate image 
according to the fifth preferred embodiment of the current invention. 

30 



12 



RCOH-1066/AP03-372 



PATENT 



FIGURE 27 is a diagram illustrating a seventh preferred embodiment that 
operates with the network connection according to the current invention. 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 

Based upon incorporation by external reference, the current application 
incorporates all disclosures in the corresponding foreign priority document from which the 
current application claims priority. 

10 

Referring now to the drawings, wherein like reference numerals designate 
corresponding structures throughout the views, and referring in particular to FIGURE 1 , a 
block diagram illustrates one preferred embodiment of the mark recognition device 
according to the current invention. The referred embodiment includes a mark detection 

15 dictionary generation unit 10 and a mark detection unit 30. The mark detection dictionary 
generation unit 10 further includes a coordinate conversion table generation unit 1 1, a 
dictionary generation image input unit 12, a polar coordinate image generation unit 13 and, 
a dictionary 20. The mark detection unit 30 further includes an image input unit 3 1, a mark 
candidate extraction unit 32, a matching unit 33 and the dictionary 20. The mark detection 

2 0 unit 30 refers to the dictionary 20 to determine whether the input image is a specified mark. 

Now referring to FIGURES 2A and 2B, graphs show a positional relation 
between a point on the XY perpendicular coordinate system and a point on the r 8 polar 
coordinate system. Referring to FIGURE 2A, the pixel position on the XY perpendicular 

2 5 coordinate system is expressed by the origin at the upper left corner, the X-axis or main 

scanning direction towards the right and the Y-axis or sub scanning direction towards the 
bottom. An image 21 is a square whose diagonal distance is 2R from the origin. 

Now referring to FIGURE 2B, the image 22 has been converted from the XY 

3 0 perpendicular coordinate to the r 0 polar coordinate system. The angle axis 9 ranges from 

0 to 2n or 360 degrees while the distance r ranges form 0 to R. The central coordinate P 0 

13 
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(xo, y 0 ) of the image 2 1 before the polar coordinate conversion corresponds to a standard 
point P' 0 (0, 0) of the rectangular image 22 after the polar coordinate conversion. 
Furthermore, a point P, (x„ has a length r from the central coordinate P 0 (x 0 , y 0 ) of the 
image and an angle 0 in the XY perpendicular coordinate system 21 before the polar 
5 coordinate conversion. The point P, (x„ y^ will be converted into a point P', (x'„ y',) on 
the r 9 polar coordinate system by the following equations: 

x'!= X! - r cos G 

y'^y^rsinO 

where the angle 0 is formed by a line X' (herein after the angular standard or base line) 
1 0 passing a point P 0 that is parallel to the x axis and a line between points P 0 and P,. 

First Preferred Embodiment 

The mark detection dictionary generation unit 10 of a first preferred embodiment 
15 will be described. In the following description, the dictionary generation image is assumed 
to be 40 x 40 pixels in a square in the XY perpendicular coordinate system. The 
coordinate conversion table generation unit 1 1 generates a table that indicates the 
correspondence between the pixels of the dictionary generation image in the XY 
perpendicular coordinate and the r 0 polar coordinate. The coordinate conversion table 
2 0 generation unit 1 1 subsequently writes the above generated table in the dictionary 20. 

Now referring to FIGURE 3, a flow chart illustrates steps involved in a preferred 
process that is performed by the coordinate conversion table generation unit 1 1 according 
to the current invention. In a step SI, a list is generated for the angle 0 and the distance r 
2 5 that correspond to the coordinate (x, y) on the XY perpendicular coordinate. The distance r 
is from the center and the rotated angle 0 is formed between the standard line X' and the 
distance r. Since each pixel is not a point, the angle and the distance are determined with 
respect to the central coordinate P 0 and the center of gravity of the pixel as illustrated in 
FIGURE 4. 

30 
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FIGURE 4 is an exemplary determination of the angular coordinates. The point 
P, (19, 19) on the XY perpendicular coordinate has: 
r = 0.5 xV2 = 0.71 
0 = 315° = 7tt/4-5.497787 

5 

Similarly, P 2 (21, 18) has: 
r = 1.5 xV2« 2.12 
0 = 225= 5ti/4 = 3.926991 

10 As described above, the coordinate values are determined as illustrated in a table 

of FIGURE 5. The exemplary data shows the correspondence between the XY coordinate 
values and the r 0 coordinate values for all listed pixels. 

Referring back to FIGURE 3 assuming that the distance r is a first key and the 
15 angle 0 is a second key, the data in the table is sorted in an ascending order in a step S2 of 
the flow chart . In a step S3 of the flow chart, according to the sorted table in the order of 
the distance r, a scale D is assigned from 0, 1, 2, 3 to a predetermined number based upon 
the r coordinate value. As shown in FIGURE 6, the scale D is not equidistant since the 
scale D is made in the polar coordinate image along the central distance direction. 

20 R = 0.71, 1.58,2.12, 

A scale F for the angle 0 of the pixel in the r 0 polar coordinate system is determined in 
accordance with the polar coordinate image size based upon the following equation in a 
step S4 of the flow chart in FIGURE 3. 

The polar coordinate image size is N x ©, where the number of pixels N is in the r 

2 5 direction and the number of pixels 0 is in the 0 direction. 

U = 2ti/0 
F = 0/U 

The scale F is an integer by counting fractions equal to or over V2 as one and disregarding 
the rest. The scale F is equidistant as in F = U, 2U, 3U, .... For example, the number of 

3 0 pixels 0 in the 0 direction is selected to be a natural number so that U becomes a central 
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angle formed by the adjacent pixels located farther away from the central coordinate. In 
the current example, the 0 value is 192. 

As shown in FIGURE 7, if 0 = 1 92, the F values are calculated in the coordinate 
5 conversion table. A pixel P xy in the XY perpendicular coordinate system is converted in a 
pixel P FD in the the r 0 coordinate system based upon the coordinate conversion table in 
FIGURE 7. The above conversion is reversible as shown in FIGURES 8. For example, 
the pixel P xy (19, 20) is converted into the pixel P FD (24, 0) in the polar coordinate. The 
generated conversion table is stored in the dictionary 20 in the step S5 of the flow chart in 
1 0 FIGURE 3. In the generated coordinate conversion table, sets of the X coordinate, the Y 
coordinate, the D scale and the F scale are sorted in the dictionary 20 for the number of the 
pixels in the r direction. For example, if the pixels are 40 x 40 in an image, the total 
number is 1600 sets in the dictionary 20. The preferred process this terminates. 

15 The dictionary generation image input unit 12 reads an image for the dictionary 

generation in one of the following manners: 

1) reading the image by a scanner, 

2) reading the image already stored in a disk device, or 

3) reading the image via a network. 

2 0 It is also assumed that the image for generating the dictionary has the same predetermined 
size as the image to be searched. In the above example, the predetermined size is 40 x 40 
pixels. 

The polar coordinate image generation unit 13 reads the image for the dictionary 

2 5 generation via the dictionary generation image input unit 12 and generates a polar 

coordinate converted image. The polar coordinate image generation unit 13 stores the 
polar coordinate image in the dictionary unit 20. The polar coordinate image is a 
rectangular image raging within the D scale and the F scale of the above described polar 
coordinate conversion table. In the above example, the D scale ranges from 0 to 166 and N 

3 0 = 167 while the F scale ranges from 0 to 191 and 0 = 192. 

16 
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Now referring to FIGURE 9, a flow chart illustrates steps involved in a preferred 
process that is performed by the polar coordinate image generation unit 13 according to the 
current invention. In a step SI 1, the pixel coordinate (x, y) of the inputted specified mark 
image is determined in accordance with the coordinate (F, D) of the polar coordinate 
5 image. The coordinate (x, y) is determined by the following equations if the central 
coordinate of the inputted specified mark image is expressed by (Xq, y 0 ). 

x = Xq - r cos 0 

y = y 0 - r sin 9 

9 = FU = 2tcF/0 

1 0 The r value is determined from the corresponding r value when the D scale value is 

calculated for the coordinate conversion table. Next, the pixel value at the above obtained 
coordinate (x, y) in the inputted image is assigned to the pixel value at the coordinate (F, 
D) in a step S12. However, since the coordinate (x, y) is not necessarily an integer, the 
pixel value is determined using adjacent pixels and by an interpolation process. These 

15 calculations are repeatedly performed for every pixel at the coordinate (F, D) in the 

rectangle. The calculated polar coordinate image is stored in the dictionary 20 in a step 
S 13. The preferred process the terminates itself. 

Now referring to FIGURES 10 and 1 1, the above described process is further 
2 0 illustrated on an exemplary mark. An exemplary mark as shown in FIGURE 10 has 

undergone the above described process. The image of the characters, "RCOH" as indicated 
by the XY directions has been processed according to the above described process to be 
converted to a polar coordinate image. The polar coordinate image is shown in FIGURE 
1 1 as indicated by the FD directions. The dictionary 20 stores the above polar coordinate 

2 5 image and the polar conversion table for each of the specified mark to be searched. 

The mark detection unit 30 further includes the image input unit 31, the mark 
candidate extraction unit 32 for extracting mark candidates from the inputted image, the 
dictionary 20 that has been generated by the mark detection dictionary generation unit 10, 

3 0 and the matching unit 33 for matching the extracted matching candidates and the specified 

mark image stored in the dictionary 20. The image input unit 3 1 reads images from other 
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computers via a network, a scanner or a storage device containing an image to be searched. 
If the inputted image is enlarged or reduced, the inputted image is scaled to a multiple of 
the size of the specified mark. The mark candidate extraction unit 32 extracts figures or 
marks that satisfy the conditions such as the peripheral shape of the specified mark from 
5 the image that has been read in by the image input unit 3 1 . For example, if the specified 
mark requires that the peripheral shape is circular, one can determine by using the 
techniques that have been disclosed in Japanese Patent Publications Hei 11-1 10562 and 
2001-331805. 



1 0 The matching unit 33 uses the polar coordinate image stored in the dictionary 20 

and the coordinate conversion table to generate a mark image per rotation angle. The 
matching unit 33 compares the extracted image to the generated image. The comparison is 
a simple overlapping comparison method by counting a number of pixels that has a 
different value at the same location. The above counted value is used to determine the 

1 5 difference. Alternatively, the disclosures in Japanese Patent Publication Hei 5-250475 and 
Hei 8-235359 are used to determine the matching degree. Furthermore, a predetermined 
characteristic value is determined per rotational angle, and the characteristic value of the 
extracted mark is compared against the above characteristic value. In the preferred 
embodiment, the above simple overlapping comparison is used since the simple 

2 0 overlapping comparison yields a significant accuracy level. 

Now referring to FIGURE 12, a flow chart illustrates steps involved in a preferred 
process of generating an image per rotational angle from the polar coordinate image by the 
matching unit 33 according to the current invention. In a step S21, a rotational angle 

2 5 counter n for the polar coordinate image is initialized to zero. In the following, the 

increment of the above counter n means to generate a rotated mark image. In order to 
generate a specified mark for all of the 40 x 40 pixels in the extracted images, the 
following steps S22 through S24 are repeated. In a step S22, for each coordinate (x, y) of 
the extracted image, the coordinates (F, D) are determined based upon the coordinate 

3 0 conversion table in the dictionary 20. The counter n value of the rotational angle is added 

to the scale value F. If the coordinate value F of the polar coordinate image exceeds the 
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number of pixels 0 in the rotational direction of the polar coordinate image, the F value is 
made within a range from 0 to 0-1 . For example, in the coordinate conversion table of 
FIGURE 7, since the polar coordinate (F, D) = (120, 0) corresponds to the coordinate (X, 
Y) = (20, 19), if n = 100, (120 + 100, 0) = (220 - 192, 0) = (28, 0). The pixel value of the 
5 coordinate (F, D) of the polar coordinate image in the dictionary 20 is extracted in a step 
S23. The above extracted pixel value is stored as the pixel value at the coordinate (X, Y) 
in a temporary memory in a step S24. For example, if the counter n is zero, the pixel value 
at the coordinate (X, Y) - (19, 20) is the pixel value at the coordinate (24, 0) of the polar 
coordinate image since the corresponding coordinate (F, D) = (24, 0). Similarly, the 

10 followings are also true: 

The pixel value of at (X, Y) = (20, 20) is that at (72, 0) of the polar coordinate image. 
The pixel value of at (X, Y) = (20, 19) is that at (120, 0) of the polar coordinate image. 
The pixel value of at (X, Y) = (19, 19) is that at (168, 0) of the polar coordinate image. 
In a step S24A, it is determined whether or not all of the pixels have been processed by the 

15 steps S22 through S24. If all of the pixels have been processed, the preferred process 
proceeds to a step S25. Otherwise, the preferred process returns to the step S22. 

The generated specified mark image that is temporarily stored in the memory and 
the extracted image are matched by overlapping in a step S25. The number of pixels 
2 0 having a unmatched pixel value is counted, and the number is compared to a predetermined 
threshold value in a step S26. If the counted value does not exceed the predetermined 
threshold value , it is determined that the specified mark is detected as in the YES branch 
of the step S26, and the corresponding detection signal is outputted for terminating the 
preferred process in a step S27. The above threshold value is experimentally determined in 

2 5 advance and is stored in the dictionary 20. For example, the threshold value is around 500. 

On the other hand, if the number of corresponding pixels having a different pixel value 
exceeds a predetermined threshold value as in the NO branch of the step S26, the rotation 
angle counter n is incremented by one in a step S28 in order to rotate the specified mark. 

3 0 If the specified mark has not been rotated for 360 degrees (i.e. n<=0) as shown 

in the YES branch of a step S29, the preferred process returns to the step S22. 
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Furthermore, even if the specified mark has been rotated for 360 degrees (i.e., n>0) but has 
not been matched as shown in the NO branch of a step S29, the preferred process 
terminates itself by outputting a non-detection signal indicative of not detecting the 
specified mark in a step S30. 

5 

In the first preferred embodiment, if a 40x40 pixel image is used as the specified 
mark image in a specified mark detection dictionary generation device, the value of D 
ranges from 0 to 166 while the value of F ranges from 0 to 191. For the above ranges, the 
matching process is performed by using the 167x192 polar coordinate image for 360 
1 0 degrees. Because 40x40x192 dictionary images are necessary in another system when 192 
rotational images are stored as rotational images for 360 degrees, the above described 
preferred process substantially reduces the dictionary capacity. 



The Second Preferred Embodiment 

15 

In the first preferred embodiment, the scale D ranges from 0 to 166 for the image 
size of 40x40 pixels by applying the same scale D for the same distance r value from the 
central coordinate of the specified mark dictionary generation image in the polar coordinate 
conversion table. In the second preferred embodiment, the polar coordinate image is 
2 0 further reduced by clustering the scale D values to make the scale D values smaller. In the 
second preferred embodiment, the table generation means 1 1 of the specified mark 
detection dictionary generation unit 10 of the first preferred embodiment is modified in the 
following manner while other functions remain substantially the same. 



25 Now referring to FIGURE 13, a flow chart illustrates steps involved in a second 

preferred process of generating the polar coordinate conversion table. For each pixel in the 
dictionary generation image of the specified mark, the distance r from the central 
coordinate and the rotational angle 0 from the angular standard line x' are determined in a 
step S3 1 . In the step S3 1 , a table is generated for the XY coordinates and the 

3 0 corresponding r 9 values. Since each pixel is not a point, the distance and the angle are 
determined based upon the central coordinate and the center of gravity of the pixels as 
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shown in FIGURE 4. When the above determination is made for all of the pixels, the table 
as shown in FIGURE 5 is generated for 40x40 pixels. Assuming that the distance r is a 
first key and the angle 0 is a second key, the generated table is sorted by an ascending order 
in a step S32. In the sorted table, the D scale on the r coordinate in the polar coordinate 
5 image is distributed in accordance with the ascending distance r value, and the maximal 
value of the scale D is stored at a Dmax in a step S3 3. Based upon the example of 
FIGURE 5, the scale D is distributed as shown in FIGURE 6. 

The scale F on the 0 coordinate in the polar coordinate image is determined in a 
1 0 step S34 based upon the following equations in accordance with the polar coordinate image 
size, Nx0, where N is the number of pixels in the r direction and 0 is the number of pixels 
in the 0 direction. 

U = 7T/@ 

F = 0/U 

15 where F is made into an integer by incrementing a fraction to a next integer if the fraction 
is above or equal to 0.5 otherwise by disregarding the fraction. For example, the above 
number of pixels 0 in the 0 direction is determined by selecting a natural number which 
the central angle between adjacent pixels at a distance from the central coordinates is U. 
For a 40x40 pixel image, if 0=192, the value F is determined as shown in FIGURE 7. 

20 

Subsequently, for the scale D in the currently generated coordinate conversion 
table the difference between the maximal and minimal r values is calculated in two 
adjacent clusters having a D value of 1 in difference in steps S35 through S42. The 
adjacent cluster having the minimal difference is merged into a single cluster. In the step 

25 S35, a class counter n is initialized to an initial value of zero in order to find out if the 

adjacent scales D in the generated coordinate conversion table belong to the same cluster. 
In the step S35, a memory location Smin is initialized to a positive infinity value in order 
to find the minimal difference between the maximal and the minimal r values in the 
adjacent cluster. In a step S36, the r differential value between the maximal and minimal 

3 0 values of n and (n+1) clusters is determined, and the r differential value is stored in 

memory S. If a S value is smaller than a Smin value as in the YES branch in a step S37, 
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the cluster counter n value is stored at a memory location N, and the Sim value is replaced 
by the S value in a step S38 before proceeding to a step S39. On the other hand, if a S 
value is larger than the Smin value as in the NO branch in the step S37, the preferred 
process proceeds to the step S3 9. 



In order to find a combination of next adjacent clusters, the cluster counter n is 
incremented by one in the step S39. If there remains an adjacent pair for processing as in 
the NO branch in a step S40, the preferred process goes back to the step S36. On the other 
hand, if there is no adjacent pair remaining as in the YES branch of the step S40, the 

1 0 previously searched cluster N and the cluster (N+l) are integrated into one in a step S41 . 
The integrated cluster D scale value is replaced by the cluster N value, and the scale D is 
renumbered without any skipping number. The maximal D max of the scale D is 
decremented by one. When the scale D=0 and the scale D=l are integrated in FIGURE 7, 
the results are shown in FIGURE 14. Lastly, the terminating conditions are checked for 

15 the clustering process. If it is completed in the YES branch of a step S42, the generated 

coordinate conversion table is stored in the dictionary 20 in a step S43. On the other hand, 
if it is not yet completed as in the NO branch of the step S42, the preferred process returns 
to the step S35 for further clustering. 

2 0 One of the following clustering terminating conditions is used in the step S42. 



5 



25 



(1) Method of clustering as long as the pixels have the one-to-one 

correspondence. As clustering is performed as described above, multiple 
pixels on the XY perpendicular coordinate image indicate a single pixel on 
the polar coordinate image. In this case, since an error is determined for 
multiple pixels by a single pixel value on the polar coordinate image, the error 
calculation precision is clearly lowered. For this reason, in the process of 
clustering, clustering is terminated when multiple pixels on the XY 
perpendicular coordinate image indicate a single pixel on the polar coordinate 



image. 



30 



(2) Method of clustering within a range where no significant difference exists 
between the error in the central angular direction and the maximal and 
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minimal differential r in the same cluster. For example, if 360 degrees are 
divided into 192, the characteristic value error in the central angular direction 
is maximal at the pixel (0,0) on the XY perpendicular coordinate farthest from 
the central coordinate. For this reason, the maximal distance in the error is 
the distance for 360/193 degrees on the circumference having a diameter of 

39V2 pixels. That is, the distance is 0.451 pixel. ((39V5 x *)/192)/2 * 0.451 
On the other hand, the characterization value error in the central distance 
direction is one half of the difference r between the maximal and minimal 
values in the same class. Before clustering, although the characterization 
error value in the central distance direction is zero, since the characterization 
error increases as clustering progresses, the clustering process is completed 
when the characterization error value in the central distance direction exceed 
0.451. 

(3) Method of determining a range where the detection performance fails to lower 
actually performing detection experiments based upon generated polar 
coordinate image. 

In the range of the scale D of the coordinate conversion table after clustering on 
the second preferred embodiment, the scale value is from 0 to 39 in an example of 
FIGURE 14. After the experimental results, the matching performance is not lowered by 
the above clustering process. For this reason, since the polar coordinate image is 40x193 
pixels, the dictionary capacity is substantially reduced in comparison to 192 simply stored 
rotated images of 40x40 pixels. For example, when a polar coordinate image is generated 
based upon the coordinate conversion table, the specified mark image of FIGURE 10 
becomes the polar coordinate image of FIGURE 15 as indicated by the FD directions. 

Third Preferred Embodiment 

In an image input device, various image processes such as edge emphasis are 
performed. The above image processes are not necessarily performed in the main and sub 
scanning directions. For example, it is not uncommon to perform the MTF correction only 
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in the main scanning direction. Similarly with the digitization process, it is not necessary 
to digitize in the equal directions. For this reason, in detecting a specified mark using the 
above image input device, the techniques as described with respect to the first and second 
preferred embodiments limit the input image in a certain direction such as a predetermined 
5 central angle. If an image is inputted in an opposite direction, it is a concern that error is 
substantial in detecting a specified mark. In order to reduce the error, in the third preferred 
embodiment, a plurality of images is prepared by rotating an image in multiple directions 
for the dictionary generating image. Using the above images, the polar coordinate image is 
generated. 

10 

The third preferred embodiment includes the specified mark detection dictionary 
generating unit 10 of the first or second preferred embodiments, and only the dictionary 
generating image input unit 12 or the polar coordinate image generating unit 13 of the 
specified mark detection dictionary generating unit 10 is modified in the third preferred 

15 embodiment in the following manner. Initially, a specified mark image is generated at an 
equal amount of rotation for the dictionary generation and is stored in a file. The above 
image is generated by mechanically rotating the image and inputted by a scanner or a 
similar device. In the alternative, a color image of a particular specified mark is rotated by 
a computer, and a plurality of rotated color images is generated after substantially similar 

2 0 image processing in the image input device. The dictionary generating image input unit 12 
outputs a pixel value at the position that is specified in one of the rotated images in the file 
by the polar coordinate generating unit 13. In the following, the steps will be described for 
generating a polar coordinate image after 192 rotated color images are digitized over 360 
degrees and are stored in the file. In the alternative, the color image itself is used to 

2 5 generate a polar coordinate image without digitization. 

Now referring to FIGURE 16, a flow chart illustrates steps involved in the 
process that is performed by the polar coordinate image generating unit 13 in the third 
preferred embodiment according to the current invention. Initially, in a step S5 1, the scale 
30 D in the central distance direction of the polar coordinate image is initialized to D=0. In a 
step S52, the rotational counter n for the rotational angle of the polar coordinate image is 
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initialized to n=0. In a step S53, the scale F having the same scale value D in the 
coordinate conversion table of the dictionary 20 and the coordinates (X,Y) of the specified 
mark image in the XY perpendicular coordinate corresponding to the polar coordinates 
(F,D) are extracted. If the coordinate F in the polar coordinate image is equal to or greater 
than the number of pixels 0 in the rotational angle direction of the polar coordinate image, 
the F value is within the range from 0 to 0-1. 

For example, if D=0 in the example of the coordinate conversion table of 
FIGURE 7, the F scale values are 24, 72, 120 and 168. That is; 

For the coordinates (24, 0) for a polar coordinate image: the coordinates (19,20) 
of a XY coordinate image. 

For the coordinates (72, 0) for a polar coordinate image: the coordinates (20,20) 
of a XY coordinate image. 

For the coordinates (120, 0) for a polar coordinate image: the coordinates (20,19) 
of a XY coordinate image. 

For the coordinates (168, 0) for a polar coordinate image: the coordinates (19,20) 
of a XY coordinate image. 

In the coordinate conversion table of FIGURE 14, if the scale D value is D=0, the F scale 
values are 24, 72, 120, 168, 10, 38, 58, 86, 106, 134, 154 and 182. Furthermore, in the 
above example, if the scale D=0 and the counter n=l, the pixel value at coordinates (F+l, 
0) of the polar coordinate image is determined at the XY coordinates (19,20); (20,20); 
(20,19) and (19,19) respectively in the four rotated images k, where 
k = 24 + 1, 72 + 1, 120 + 1 and 168 + 1 as shown in FIGURE 18. 

Among the rotated images, the pixel values at the XY coordinate image of the 
rotated images having the above obtained F scale values are extracted by the dictionary 
generating image input unit 12. The number of white and black pixels among the extracted 
pixels is stored respectively at the memory W and B in a step S54. For example, if F=24, 
the pixel value is at the XY image coordinate (19, 20), which is 24th (k=24) among the 192 
rotated images as shown in FIGURE 17. Similarly, if F=72, the pixel value is at the XY 
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image coordinate (20, 20), which is 72 (k=72) among the rotated images. Others are also 
similarly extracted. 

If the black pixels B exceed the white pixels W in number as the YES branch of a 
5 step S55, the pixel value at the coordinate (n, D) in the polar coordinate image is the white 
pixel value in a Step S56. On the other hand, the black pixels B are equal to or smaller 
than the white pixels W in number as in the NO branch of the Step S55, the pixel value at 
the coordinate (n, D) in the polar coordinate image is the black pixel value in a step S57. 
In a step S58, the counter n is incremented, and the above described steps S53 through S57 

10 are repeated until the pixel value 0 is reached in the rotational angular direction. The 
increment in the counter n means that the polar coordinate image is rotated by 360/192 
degrees. The scale D is incremented by one, the above steps S52 through S58 are repeated 
until the scale D reaches the maximal value in a step S59. When all of the coordinates (F, 
D) are finished in the polar coordinate image, the calculated polar coordinate image is 

15 stored in the dictionary 20 in a step S60, and the preferred process terminates. The polar 
coordinate image is generated by referring to a plurality of dictionary generating images 
that correspond to the input direction in the above described manner. The above reference 
prevents the detection performance of the specified mark depending upon the original 
scanning direction. In the above example, the digitized image is used. If a color image is 

2 0 used, instead of using the number of black and white pixels, the pixel values are 

interpolated. 

Fourth Preferred Embodiment 

25 For example, if four pixels in the XY coordinate image have the same D scale 

value, these four pixels are rotated 90 degrees from each other. In this situation, instead of 
using the X' axis as in FIGURE 2 as the standard line for determining the central angle, the 
central angle of one of the four pixels is used as the standard. When the number of pixels 
0 is a multiple of four, the characteristic value error in the central angular direction 

3 0 becomes zero. In the fourth preferred embodiment, among pixels having the same scale 

value D, the central angle of one of these pixels is used as the standard to determine the 
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central angle of other pixels so that the characterization value error in the central angular 
direction is reduced. In the fourth preferred embodiment, the specified mark detection 
dictionary generation unit 10 of the previously described preferred embodiments is altered 
in the following manner. The specified mark detection unit 30 is substantially identical 
5 and will not be described. The coordinate conversion table generating unit 1 1 generates 
the pixel coordinates in the XY perpendicular coordinate system of the dictionary 
generation image and the coordinate conversion table indicating the correspondence to the 
pixels in the r 0 polar coordinate system. The coordinate conversion table generating unit 
1 1 stores the above generated information in the dictionary 20. 

10 

Now referring to FIGURE 19, a flow chart illustrates steps involved in a preferred 
process of the coordinate conversion table according to the current invention. In a step 
S 61, for each pixel in the specified mark dictionary generating image, the distance r from 
the center and the rotational angle 0 from the angular standard line X' are determined. In 

1 5 the step S6 1 , a list is generated for the pixel coordinate (x, y) in the XY perpendicular 
coordinate and the corresponding distance r and angle 0 values. Since each pixel is not a 
point, its distance and angle are determined based upon the central coordinate and the 
center of gravity for all of the pixels. Thus, the list as shown in FIGURE 5 is generated. 
According to the distance r as the first key and the angle as the second key, the generated 

2 0 list is sorted in the ascending order in a step S62. In the sorted list, the scale D value is 
distributed from 0, and the scale D in the above example is distributed as shown in 
FIGURE 6 in a step S63. 

For all of the above scale D values, the scale F is determined by repeating steps 

2 5 S64 and S65. For the pixels having the same scale D value, the pixel having the least 0 is 

sought in a step S64, and the above 0 value is used as a standard angle B. For the pixels 
with the same scale D value, the scale F on the 0 coordinate in the polar coordinate image 
is determined according to the polar coordinate image size based upon the following 
equation in a step S65. The polar coordinate image size is N x 0, where the number of 

3 0 pixels is N in the r direction and the number of pixels is 0 in the 0 direction. 

U = 2ti/ 0 
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F = (0 - B) - U 

where F is made into an integer by incrementing a fraction equal to or above 0.5 and by 
disregarding the rest. For example, the number of pixels 0 in the 0 direction is selected by 
an integer so that U becomes the central angle between adjacent pixels at a distance from 
5 the central coordinate. If the image is 40 x 40 and 0=192, the F value is determined as 
shown in FIGURE 20. In a step S66, the generated coordinate conversion table is stored in 
the dictionary 20, and the process terminates. The data structure of the generated 
coordinate conversion table is the same as that in the first preferred embodiment. 

10 If the standard is changed for the central angle determination as described above, 

the detection performance has been experimentally confirmed for improvement by 
changing the steps by the polar coordinate image generating unit 13 in generating the polar 
coordinate image to those shown in a flow chart of FIGURE 21. The following will be 
described for the situation where the 192 digital dictionary generating images are prepared 

15 as the third preferred embodiment. In a step S7 1 , the scale D value in the central direction 
of the polar coordinate image is initialized to zero. In a step S72, the counter n for the 
rotational angle in the polar coordinate image is initialized to zero. The scale F having the 
same scale D value in the coordinate conversion table in the dictionary 20 and the 
corresponding coordinates (X, Y) of the specified mark in the XY perpendicular coordinate 

2 0 are extracted in a step S73. The rotational angle counter n value is added to the above F 
scale in the step S73. If the coordinate F in the polar coordinate image is equal to or more 
than the number of pixels 0 in the rotational angular direction in the polar coordinate 
image, the F value ranges from 0 to 0-L For the example of the coordinate conversion 
table in FIGURE 20, if D=0, the scale F has four points including 0, 48, 96, and 144. That 

2 5 is, 

The polar coordinate image (0, 0): The XY coordinate image (19, 20) 
The polar coordinate image (48,0): The XY coordinate image (20, 20) 
The polar coordinate image (96,0): The XY coordinate image (20, 19) 
The polar coordinate image (144,0): The XY coordinate image (19, 19) 

3 0 In the above example, if the scale D=0 and the counter n=l, the pixel values at the polar 

coordinate image (F+1,0) are the pixel values at the XY coordinate image (19, 20), (20, 
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20), (19, 19) respectively for the four rotational images at K=0+1, 48+1, 96+1 and 144+1 a 
shown in FIGURE 23. 

Subsequently, among the rotational images having the same amount of rotation as 
5 the F scale value, the pixel values at the extracted XY coordinate image (X, Y) are 

determined for the dictionary generating image input unit 12 in a step S74. Among the 
extracted pixels, the number of white pixels is stored in the memory W while the number 
of black pixels is stored in the memory B in a step S74. For example, if F=0, the pixel 
value at the coordinate (19, 20) in the XY coordinate image is extracted for the 0 th (k=0) 

10 image among the 192 rotational images as shown in FIGURE 22. If F=48, the pixel value 
at the XY coordinate image (20, 20) is extracted for the 48 th (k=48) image. Similarly, other 
pixel values are taken. If the number of the black pixels (B) exceeds that of the white 
pixels as in the YES branch of a step S75, the pixel value at the polar coordinate image (n, 
D) is replaced by the black pixel value in a step S76. On the other hand, if the number of 

15 black pixels (B) is smaller than that of the white pixels (W) as in the YES branch of a step 
S77, the pixel value at the polar coordinate image (n, D) is replaced by the white pixel 
value in a step S78. Furthermore, if the number of white (W) and black (B) pixels is the 
same as in the NO branch of a step S77, the pixel value at the polar coordinate image (n, 
D) is replaced by the pixel value of the standard pixel for determining the central angle in a 

2 0 step S79. The above steps S73 through S79 will be repeated until the counter n reaches the 
pixel value 0 in the rotational angular direction after the counter n is incremented in a step 
S80. The incrementing the counter n by one is to rotate the polar coordinate image by 
360/192 degrees. In a step S81, the above steps S72 through S80 are repeated until the 
scale D reaches the maximal value after the scale D is incremented by one at a time in a 

2 5 step S8 1 . After the determination is complete for all of the coordinates (F, D) in the polar 
coordinate image, the generated polar coordinate image is stored in the dictionary 20 in a 
step S82, and the process terminates itself. In the above, although the process is described 
for a digital image, for a color image, the pixel values are interpolated rather than the 
number of black or white pixels. 
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The polar coordinate image is generated based upon the coordinate conversion 
table of the fourth preferred embodiment. For example, the specified mark image of 
FIGURE 10 becomes the polar coordinate image of FIGURE 24 as indicated by the FD 
directions. If the clustering process of the second preferred embodiment is performed on 
5 the coordinate conversion table of the fourth preferred embodiment, the specified mark 
image of FIGURE 10 becomes the polar coordinate image of FIGURE 25 as indicated by 
the FD directions. In FIGURE 24 or 25, since the standard is different for each scale D in 
determining the central angle, the image is observed to have a shift for each scale D in the 
central angular direction in comparison to FIGURES 1 1 and 15. 

0 

Fifth Preferred Embodiment 



The matching unit 33 of the specified mark detection unit 30 in the above 
preferred embodiments performs the matching process after the whole XY coordinate 
15 image is reconstructed from the polar coordinate image. In the fifth preferred embodiment, 
the matching process is performed by a simple overlap without reconstructing the entire 
XY coordinate image. In the fifth preferred embodiment, the functions of the image input 
unit 3 1 and the specified mark candidate extraction unit 32 of the specified mark detection 
unit 30 as well as the specified mark detection dictionary generating unit 10 are 

2 0 substantially identical to those of the above described preferred embodiments. The 

corresponding description will not be repeated. 

Now referring to FIGURE 26, a flow chart illustrates steps involved in a preferred 
process of matching by the matching unit 33 according to the fifth preferred embodiment. 
25 In a step S91, the rotational angle counter n for the specified mark image and the 

unmatched pixel counter E are both initialized to zero in a step S91. The pixel value is 
taken in a step S92 at the single coordinate (X, Y) among the specified mark candidate 
images that have been taken out by the mark candidate extraction unit 32. The above pixel 
value is assigned to Pi. The polar coordinate image at (F, D) is determined for the 

3 0 coordinate (X, Y) based upon the coordinate conversion table in the dictionary 20 in a step 

S93. The counter n value is added to the above scale F value in a step S93. If the 
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coordinate F in the polar coordinate image exceeds the number of the pixels 0 in the 
rotational direction in the polar coordinate image, the F value ranges from 0 to 0-1. For 
example, in the coordinate conversion table of FIGURE 7, since the coordinates (X, Y) = 
(20, 19) correspond to the polar coordinates (F, D) = (120, 0), if n=100, (120 + 100, 0) = 
5 (220 - 192, 0) = (28, 0). For the above reasons, the corresponding pixel values in the 

specified mark image for the coordinate (X, Y) = (20, 19) are those at the polar coordinate 
image (28, 0). In a step S94, the pixel values at the above obtained polar coordinate image 
(F, D) are extracted and are assigned to Pr. In the same example, in the coordinate 
conversion table of FIGURE 7, the coordinates (X, Y) = (18, 19) correspond to the polar 
10 coordinate image at (F, D) = (182, 1). The pixel values at the XY coordinate image (18, 
19) become the pixel values at the polar coordinate image (182, 1). 

The specified mark candidate image pixel value Pi and the specified mark image 
pixel value Pr are compared in a step S95. If they are different as in the YES branch of the 

15 step S95, the unmatched pixel counter E is incremented by one in a step S96. If the 
preferred process has not been completed for all of the pixels in the specified mark 
candidate image as in the NO branch of a step S97, the preferred process returns to the step 
S92. On the other hand, upon completing the process on all of the pixels in the specified 
mark candidate image as in the YES branch of the step S97, if the unmatched pixel number 

2 0 counter E has not exceeded a predetermined threshold value as in the YES branch of a step 
S98, it is determined that the specified mark has been detected and the process is 
terminated by outputting a detection signal in a step S99. The above threshold value has 
been experimentally determined. On the other hand, if the unmatched pixel number 
counter E has exceeded the predetermined threshold as in the NO branch of the step S98, 

25 the specified mark rotational counter n is incremented by one in a step S100. If the counter 
n value has exceeded the pixel value 0 in the rotational angular direction of the polar 
coordinate images as in the NO branch of a step S 101, it is determined that the extracted 
specified mark candidate image is not the specified mark. The preferred process terminates 
by outputting a non-detection signal in a step S 102. On the other hand, the counter n value 

30 is equal to or has not exceeded the number of pixels 0 in the rotational direction of the 
polar coordinate images in the YES branch of the step S 101, the unmatched pixel number 
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counter E is initialized to zero, and the preferred process returns to the step S92. As 
described above, since error is determined for each pixel, there is no need for 
reconstructing the XY whole image. The memory capacity necessary for matching is 
substantially reduced. 

5 

Sixth Preferred Embodiment 

The current invention is carried out by a software program stored in a computer 
memory or a memory device. The functions of the above described preferred embodiments 
10 of the specified mark recognition device are implemented by a software program. 

Alternatively, the functions of the specified mark detection dictionary generating device or 
the specified mark detection device are both implemented by a software program. The 
above implemented software programs are stored in a recording medium such as CD- 
- ROM, and the CD-ROM is placed in a drive device such as a CD-ROM drive for reading 
15 the program into a computer memory or another memory and for executing it. 

The software itself read that is from the recording medium implements the 
functions of the above described preferred embodiments. Furthermore, the program or the 
recording medium containing the program are also within the scope of the invention. The 

2 0 recording media include a semiconductor media such as ROM and non- volatile memory 
cards, optical media such as DVD, MO, MD and CD-R as well as magnetic media such as 
magnetic tapes and floppy disks. By executing the loaded program, not only the functions 
of the above described preferred embodiments are implemented, but also a part or a whole 
of the process is performed by the operating system based upon the instructions from the 

2 5 program. The process may also implement the functions of the preferred embodiments. 
The above program is stored in a memory device such as a magnetic disk of a server 
computer, and the program is distributed by downloading among the users who are 
connected via a network such as the Internet. The memory device of the server computer 
is also within a scope of the current invention. 

30 
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Seventh Preferred Embodiment 

Now referring to FIGURE 27, a diagram illustrates a seventh preferred 
embodiment that operates with the network connection according to the current invention. 
5 That is, the users use the terminals 40 to transmit the specified mark detection image to the 
specified mark detection unit 50 according to the current invention that is connected via the 
network 60. The users subsequently receive the detection results and output the results. 
The specified mark detection unit 50 includes the dictionary that has been generated by the 
specified mark detection dictionary generating unit according to the current invention. 

1 0 Specified mark candidates are extracted from the images received from the user terminals 
40. After matching with the dictionary, the results are returned to the terminals 40. By the 
above, the detection service is performed to determine whether or not a specified mark 
exists in the image that the user possesses. Each unit of the current invention is used in the 
following manner. Firstly, the user generates a dictionary for own use by the specified 

15 mark detection dictionary generating device according to the current invention. Secondly, 
the specified mark detection software program without a dictionary is down loaded to the 
user terminal40 via the network from the server computer. The specified mark is being 
detected by the above detection software program or an application program including the 
above detection software program along with the previously generated own dictionary. 

2 0 Thus, the most recent specified mark detection program is always advantageously available 
for use. 

Eighth Preferred Embodiment 

2 5 The above described invention for detecting the specified mark is implemented by 

a circuit. For example, to detect a printed or etched specified mark on the surface, a 
plurality of the specified mark dictionaries is necessary. The specified marks include bank 
marks printed on currency of each country and the designs on various coin surfaces. The 
electronic circuit having the function to detect the specified mark is placed in a copier or a 

3 0 sorting machine in order to prevent the duplication of paper currency or to apply to the 

sorting task at a factory or in a distribution process. In the above case, the matching means 
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of the specified mark detection device for detecting the specified mark is implemented on a 
electronic circuit. For each of the electric circuits, a dictionary is provided, and the electric 
circuit is operated. Based upon the detection or non-detection signal, it is determined 
whether or not a specified mark has been matched to generate a final detection signal. 

It is to be understood, however, that even though numerous characteristics and 
advantages of the present invention have been set forth in the foregoing description, 
together with details of the structure and function of the invention, the disclosure is 
illustrative only, and that although changes may be made in detail, especially in matters of 
shape, size and arrangement of parts, as well as implementation in software, hardware, or a 
combination of both, the changes are within the principles of the invention to the full 
extent indicated by the broad general meaning of the terms in which the appended claims 
are expressed. 
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